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Abstract 


A Gibbs distributed image is one in which the probability distribution of pixel 
intensities is a Gibbs distribution. The distribution function is characterised by a 
set of parameters. In this work, an image generation method known as the spin-flip 
algorithm has been used to generate Gibbs distributed images with varying sets of 
parameters and the effect on the texture of the image of changing various 
parameters has been studied. Also, an attempt has been made to come up with a 
parameters estimation method based on histogramming . The method has been tested 
on various simulated images. Further, an image compression method has been 
proposed that operates by modelling images as Gibbs distributions. A compression 
ratio of two has been obtained for various simulated images. A texture classifi- 
catio.n method has been suggested that depends upon minimising the Euclidian norm 
from the parameter set of the image to the parameter set of each class. 


Satisfactory results have been obtained. 



Chapter 1 


Introduction 


1.1 MOTIVATION 


The recognition that a class of images could be realistically described by Gibbs 
distribution opened up interesting possibilities for processing of images. 

A Gibbs distributed image is one in which the probability distribution of the 
pixel intensities is a Gibbs distribution. Gibbs distributions were initially used to 
model molecular interactions in ferromagnetic materials. Later-; they were used as 
models for binary alioys; lattice gas and for agricultural studies .[131 

In the past two decades, interest in the use of the Gibbs distribution has 
intensified in the field of image processing. The equivalence of Gibbs distri- 
butions and of Markov random fields that was proved in the first half of the i970s 
eliminated certain difficulties in dealing with conditional distributions in Ma.rkov 
random fields [i4X Ci51. In the use of the Markov random field, it was necessary to 
explicitly state the form of certain joint distributions; the need for this was 
eliminated when the equivalent Gibbs distribution was used instead. It was 
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primarily the increased facility resulting from the possibility of substituting an 
equivalent Gibbs distribution formulation that did not entail the complexities 
inherent in a Markov random field model that encouraged the extensive use of the 
Gibbs distribution in image processing problems. 

Various algorithms USX E2Q] have been devised for generating Gibbs 
distributed images and estimating their parameters. While for generating Gibbs 
distributed images, satisfactory algorithms such as the spin-filp and the 
Metropolis algorithm were invented, (these methods have been extensively studied 
in the physics literature.), for the estimation of parameters, there are not many 
well established methods. Although Besag's method Ci3] for estimating the 
parameters is known to give good .results under certain conditions, it does not 
always prove successful [13]. Also, the use of the models in various applicatioms 
such as image compression, image interpolation, image classification, etc. is yet to 
be thoroughly studied. 

In this thesis, we study various aspects of the spin flip algorithm by using 
the algorith.m to generate Gibbs distributed images. Also, a parameter estimation 
method based on histogramming has been presented. Next, we explore the 
application of the Gibbs distribution to the problems of image compression and 
texture classification. 


1.2 HODELLIHG OF [MAGES 

Images can be represented in many ways, such as as a rectangular lattice of point 


sites with the intensity at each point taking values from a countable set, or as a 
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rectangular lattice of point sites with the intensity at each point taking values 
from an uncountable set. In gsneraL the intensities in an image might appear to 
take values in a continuous space., but dealing with continuous variables is 
computationally inconvenient; so, we represent images as rectangular lattices of 
point sites with the values of the points lying in a discrete space. From now on, 
we call a lattice point a pixel. Mathematically, an image is a two dimensional array 
with each element in the array taking values in discrete space. 

The purpose of modelling an image is to capture the inherent regularities in 
an image. We can model an image as one in which each pixel intensity is some 
function of the neighbourhood pixels' intensities and of the pixel's location in the 
image. This approach leads us to a deterministic way of modelling an image. A 
different approach which is often used is to model the image as a random field. We 
follow the latter method. 

Initially, there were two approaches to modelling images as spatial stocha- 
stic processes. In the following discussion, we label image pixels by (ij) and with 
each pixel we associate a random variable The first approach requires that 

the joint distribution P(.X[i,13 X[i,2]=Xi^2^ •••> .X[HH]=x^P should be in 

product form, TitU with each term in the product having the form 

where is the value of the random variable XCiJl and is the 
neighbourhood (the neighbourhood of a pixel is a set of pixels that are associated 
with it by a rule) of pixel (IJ). The second approach suggests that the probability 
distribution of XCiJl conditioned over all site intensity values except of (IJ) itself 
should depend only upon some neighbourhood site intensity values. It has been 
established through the Hammersely — Clifford theorem [133 that both these 
approaches are eciuivalent. Since the Markov random field model is a conditional 
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probability model and the Gibbs distribution model is a joint distribution model; the 
Hammersely — Clifford theorem effectively establishes the equivalence of Markov 
random fields and Gibbs ditributions. 

Every model is characterised by its parameters. Once the model has been 
selected; the estimation of parameters is an important problem. There can be two 
types of situations: one is where many realizations of images are given and we 
need to estimate the parameters for the single model that governs the behaviour 
of all the images; the other is where only a single image realization is given and 
it is required to estimate the parameters from that image alone (this situation 
calls for certain assumptions of ergodic behaviour, as what is being attempted is 
to estimate the parameters of the distribution from the single available 
realization). In the former case, the parameters can be allowed to vary even from 
pixel to pixel but in the latter case, the pa.r'ameters would have to remain same for 
sufficiently large regions of the image, in order that the parameters may be 
estimated accurately. 

In a Markov random field, the probability distribution of any pixel is 
dependent upon the (intensities at the) neig.hbourhood pixels. The dependence can 
be assumed to be of a causal kind or of a non-causal kind. In a causal model, the 
probability distribution of XCi,j3 is conditional only upon XCk,23 for all <k,l) in a 
subset of the region formed by k<i and l<j, whereas in a non-causal model, the 
probability distribution of X[i,j3 is dependent on X[k,I3, for all (k,l) in a subset of 
the entire lattice, merely excluding the pixel (i,j) itself. We use only the non-causal 
models because they are more realistic in the context of images. 
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If the probability distribution of XEiJ] for all (i,j) is modelled as being 
dependent upon the nearest four pixels, it is called a first order model. If, 
instead, the distribution is modelled as dependent upon the nearest eight 
neighbuorS; it is called a second order model. In a similar fashion, still higher 
orders can be defined. As the order increases, the parameters also increase in 
number; thus, dealing with higher order models is oomputatio.nally complex. 

As already mentioned, for the generation of Gibbs distributed images, there 
are well established algorithms — these are the Metropolis algorithm and the spin- 
flip algorithm. In both these algorithms we start from an arbitrary image and then 
pe»^form a sequence of state changes such that the resulting image distribution is 
the required Gibbs distribution. The state changes can be carried out in an 
asynchronous or in a synchronous fashion. In a synchronous type of updating, all 
pixels change state simultaneously. In an asynchronous type of updating, one pixel 
is changed at a time and with the change introduced, the next pixel is updated and 
so on. Pixel selection can also be done in a deterministic or a random fashion. In 
case of asynchronous updating the only condition that should be satisfied while 
selecting the pixels is that each pixel should be visited equally often in the mean. 


1.3 APPLICATION OF GIBBS DISTRIBUTED IMAGES 

The use of the Gibbs distribution in image processing is fairly reoent^ but the 
potential for its use in statistical image models is enormous. Most of the work 
until now has been concentrated to devise image segmentation algorithms. Initially; 
segmentation algorithms requiring many passes C223 were designed but recently, 
segmentation algorithms requiring only a single pass [223 have appeared. Adptive 
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segmentation algorithms C23] which simultaneously estimate the parameters of the 
Gibbs random field and segment the noisy images corrupted by additive independent 
Gaussian noise have also been devised. Gibbs models also find applications in 
modelling fractals [253. Algorithms for yielding binary fractals by modelling images 
as Markov random fields have also been devised C25j. 

Recently; reports of the use of Gibbs models in the field of texture classifi- 
cation have also appeared [273. These models have also been used to model carpets 
and to identify defective textile textures [323. Classification of rotated and 
scaled textures can also be done using these methods [273. 

Applications of Gibbs models in the area of image compression; interpolation 
etc.} to the author's knowledge; have not been reported in the literature. In this 
thesiS; an attempt has been made to apply Gibbs models i.n the field of image 
compression and texture Glassification. 

lA ORGANISATION OF THE THESIS 

In this thesis we have investigated various aspects relating to the generation of 
the Gibbs distributed images. Convergence properties of the spin-flip image 
generation algorithm for cases with and without annealing have been investigated 
and effects of changing various parameters have also been studied. Also proposed 
is a parameter estimation method based on histogramming the image. Next, the Gibbs 
distribution models are applied for image compression and texture classification. 


All the ideas have been tested o.n simulated images. 
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In Chapter 2; we briefly discuss the previous work on Markov random fields 
and Gibbs distributions . In Chapter 3, we discuss the various aspects of an image 
generating algorithm; the spin-flip algorithm. In the same chapter; we also discuss 
a parameter estimation method. Using the method; paramete.r-s of various simulated 
images are estimated: thea using the estimated parameters; images are again 
generated. The textures of the initial and final images are compared. In Chapter 4; 
the application of Gibbs models to image compression and texture classification is 
discussed. Various examples supporting the ideas have been presented. In Chapter 
5; we present the conclusions and some suggestions for futu.r^e work. 



Chapter 2 


Review of the Relevant Literature 


The application of statistical models, particularly of the Harkov random field 
modelS; to image processing has increased considerably in recent years. In this 
chapter, we present the definitions and issues related to Harkov random fields. 


2.1 MARKOV RANDOM FIELDS IN IMAGE PROCESSING 

There is a vast body of literature on various spatial interaction models and image 
restoration and parameter estimation algorithms based on Markov random field 
models. In their work on Markov random fields (HRFs) Dobrushin [11, l4ong 111 and 
Woods C33 extended the Markovian property from one dimension to higher 
dimensions. However, the computational complexity of the algorithm in two 
dimensions necessitates restrictions on the class of MRF models. The model for 
images is restricted to a special class of MRFs called Markov mesh random fields 
(MMRFs) which are characterised by causal transition distributions. This approach 
has been proposed by Abend et al [41. Woods a.nd Radevan [51 also use MMRFs for 
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image processing applications. Other attempts in extending the Markovian property 
to two dimensions include include autoregressive models: the "simultaneous auto 
regressive models" (SAR models) and the "conditional Markov" models introduced by 
Chellappa and Kashyap [61. 

There are various applications of Markov random fields and two dimensio.nal 
autoregressive models in image segmentation. MRF models, Bayesian approaches and 
MAP formulations are combined in the work by Kaufman et al C73 with reduced 
update Kalman filtering techniques. Therrien C83 uses two-dimensional autore- 
gressive texture models for texture based segmentation. Hansen and Elliott [91 also 
suggest a segmentation method using MRF models and MAP formulation. However, 
until the equivalence of MRFs and Gibbs distribution was discovered, the full 
power of MRFs to capture spatial interactions could not be exploited. 

The Gibbs distribution (GD.^ introduced by Ising CiOl in 1925 was used to 
model molecular interaction in ferromagnetic materials. Gibbs distributions have 
also been used as models for lattice gas Ciil, binary alloys CiZl, and for agri- 
cultural studies in the pioneering work by Besag CiSl. The Gibbs distribution also 
has applications in neural modelling of inference and learning, social and economic 
models, optimal VLSI design applications and image processing applications. 

The eqi valence of GDs and MRFs was proved independently by Avertizev Ci4] 
and Spitzer CiSl. The celebrated work by Besag [133 laid the ground work for GD 
characterization of MRFs. Kinderman and Snell CIS! also present a detailed study 
of GD-MRF equivalence. The GDs and MRFs eliminated the difficulties involved in 
dealing with conditional distributions in MRFs, because the joint distributions are 
readily available in the form of the Gibbs distribution function. Hassner and 
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Skalansky [173 us6d Gibbs distributions to model textures. They used a •First order 
binary MRF; the Isiny models to characterise binary textures; they also presented 
a.n algorithm for generating textures and for finding the .paramters. Cross and Jain 
[183 generalised it for the M-ary case. They used Besag‘*s coding method to 
estimate parameters and the Metropolis algorithm [193 to generate the texture. In 
the work by Geman and Geman £203; the Gibbs distribution characterisation of MRFs 
is used to develop image segmentation methods. 

Cohen and Cooper [213 also used GDs for image segmentation. Derin, H and 
co-workers £223, present GD models for noisy and textured images. Lakshmanan and 
Derin 1231 propose an adaptive segmentation algorithm (ASA); which simultaneously 
estimates the parameters of the underlying Gibbs random field (GRF) and segments 
a noisy image corrupted by additive independent Gaussian noise. Geiger, D and 
Girosi; F [243 derive a deterministic approximation to MRFs. This .model is applied 
to smoothen an image preserving its discontinuities. Dnural; L £253 proposes a 
procedure to yield textures and connected binary fractals. Ari Veijanen E263 
proposed a new estimator for estimating the parameters of an MRF from noisy 
observations. Cohen et ai £273 present a Gaussian MRF-based rotated and scaled 
texture classification method. 


2.2 MARKOV RANDOM FIELDS 

Ule consider a two dimensional lattice of points L defined as 

On this lattice, we define an image random field M as 


X = CX(i,j)i l£j£N2}. 
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For our purpose, the points of the lattice correspond to the pixels of a digitised 

imaie. 


DEFINITION 2.1 Neighbourhood: The neighbourhood v^j of pixel UJ) satisfies the 

follomng conditions. 

(a) (I j) g (1, J) e L 


(b) (k^ 1) C j) K: Vifi'f Ci.t J) C L 

DEFINITION 2.2 N&lghbourhood Syste/n: A neighbourhood systen^ Is defined as 


...i 


...2 


DEFINITION 2.3 Randa/T? Field- Let L be a lattice and V be a neighbourhood 

system defined o\/er L, A random field X = CYCi jl, (i^ j) €L} Is a Harkov random field 

(HRF) with respect to the neis?hboi/rhood system f) if and only if 

P(X(i, i)=Xij/X(k, 2)=Xfe2; ik^ 1)€L, (k, 3^) 

= Pirn j)=x,v/X(k, D=Xfci; (k-; 2)€r/,.^.); (i,j)€L. ...3 

By taking large neighbourhoods, elaborate spatial dependences can be modelled. But 

for most images of interest, simple neighbourhoods are adequate. A hierarchy of 

neighbourhood systems that are used in image processing is 7?^, 7]^, .... 77^=;{T?j‘j} 

where consists of the nearest four pixels of each (iJ)€L. Similarly 1]^ = ip 

where consists of the nearest eight pixels of each (i,i) and so on. Fig 2.i shows 
•*%/ 

vfj, njj, r?t-- 

The conditional distributions in equation (3) are called the local 
charactristics of the random field. This characterization is intutively appealing 
because it is natural tc expect that the intensity of a pixel depends on its 
neighbouring pixels rather than upon those outside its neighbourhod . 
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Figure 2«1 
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Every Markov random field with P(X=:x)>0;Vx is also a Gibbs distribution 
end vice versa. This equivalence makes it much simpler to write down the joint 
distribution in an explicit form. The condition that P(.X=x)>0;Vx is a requirement 
for proving the Hammersley— Clliford theorem, which states that an MRF with 
PCX=x)>0;Vx has the same probability structure as a Gibbs distribution and vice 
versa. A detailed account can be found in Besag Ci33. 


2.3 GIBBS DISTRIBUTIONS 


Before defining a Gibbs distribution we have to define a clique. Let us first 
define the cliques associated with (L, t?), a lattice-neighbourhood system pair. 

DEFINITION 3.' A clique of the pair (L, I?), denoted by c, is a subset of L such that 

a) c consists of a single pixel, or 

b) (i, 1) and (i, j)€c and (k, l)£c =» (i, 

The collection of all cliques of (L,r?) is denoted by CiUV). The cliques associated 
with and rf are shown in Fig 2.2. U'e now define a Gibbs random field (GRF). 


GIBES RANDOM FIELD'. Let 7? be a neighbourhood system defined oi^er a lattice L. A 
random field .X=C.x,-^} defined on L is a Gibbs random field (6RF) (or a random field 
haying a Gibbs distribution) with respect to the neighbourhood system n if and only 
if its joint distribution is of the form 

...4 


P(X=x) = 


where 


U(>; 


(X) = Xc(x) i 


CSC 


&nergy function. 




J Neighboiirhood systen 


Clique Types in 



i 

Clique Types in 


(b) 

Fig 2 -2 : Ne igJ^lJDurhood. Systews and 
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and 


= z 




= partition function. 


2 is a normalising constant, so that the sum of the orobabilities of all 
realisations is unity. The clique potential i^cCx) is any arbitrary function, with the 
only necessary condition that it should be a function of the pixel values in the 
clique. Ising tiOl first used a special type of GD to model a binary nearest 
neighbour system. 


The joint distribution function in equation (4) has the interpretation that 
the smaller the energy t/(x), of a realisation of the state x becomes, the more 
probable is the realisation of that state. In studies related to physical systems, a 
temperature term is introduced in the exponent of the joint distribution and the 
exponent is. expressed as ~L/'(x)/T where T is the temperature and U*(k) is the 
energy function. The interpretation of the effect of T is that when T is large then 
a great many realizations are possible. 

A temperature parameter is useful if the state of the 'system' is desired to 
converge to a minimum energy state by passing through state transitions from an 
arbitrary initial state. If the temperature T is decreased according tc a given 
schedule so that the state of the system gets caught among highly probable states, 
then convergence to the lowest energy state is assured. This process is called 
annealing. But if the temperature is decreased too fast, the system can get locked 
in a local mnimum energy state and the global minimum energy state may never be 
reached. The schedule according to which the temperature is to be decreased is 
called the annealing schedule [20]. The fastest rate of temperature decrease that 
may be permitted is an important consideration . 
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We now state the Hammersley-Clifford theorem that describes the one-one 
correspondence between MRFs and GDs. The proof can be found in C133, IL61. 

THEOREM-1 Let V be a neighbourhood system defined on a finite lattice L. A 
random field X = Cx^-^-3 is a Markov random field with respect to V if and only if its 
joint distribution is a Gibbs distribution. 


In proving this t.heoramj P(X=x.^>0;Vx is an essential condition. It follows from this 
theorem that MRF satisfies the following distribution function; 


P(X<i,: j)=x^j/X(k, l)=Xfcj; (k, 1)€T?, ;) 


exp^ 


...5 


2A A GLASS OF VALID GIBBS DISTRIBUTIONS 


The Hammersley — Clifford theorem addresses the question of the general form of 
the energy function U(x) that must be maintained so as to ensure a valid 
probability structure of an MRF. The theore,-” states that any 'f^unoiion of the 


following form is valid. 


iJ(x) 



n , • ( Y • • ) 




U £-'v‘ 2 i 




w‘-6'-e .V, is a function of Within the general framework of 

equation C6),. we car. make pan-ticular choices depending on their suitability to the 
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practical situation we wish to deal with. For example; if Uix) is defined in the 
following form; 


C-‘2/^’23 

the models obtained are called auto-models. 


.) 


AUTO hODELS: Besag has described the following classes of auto models [131. 

i. Auto-logistic ■ For a binary random field; if the energy function is of the 
following form 


U(x) 


>=s 




■f 


X.- 


• X • * j(3 ‘ ' • ' 

i 2 *' 2 ^^ i w' 2 


U2J2S 

where and constants with respect to site locations but 

depend upon the clique configuration, the model is called an auto logistic 
model. Auto logistic models have been used by Flinn [123; Cohen and Cooper 
[213 and Hassner and Skaiansky [173. 

Auto-normai models: If the set of random variables that constitute the 
random field are jointly Gaussian; it can be seen that the quadratic in the 


exponent of their joint distribution is of the form of equation (6). Such a 
model is called an auto normal model £133. 


3, Auto-Poisson model: The auto-Poisson model introduced by Besag £133; is 


defined such that each random variable in the random field is conditionally 
Poisson distributed with parameters depending upon the neighbours of that 


random variable. 

Derin £303 proposes yet another kind of auto-model which is versatile and 
powerful. Suppose that each of the random variables X£ii;ji3 takes one of the 
H values m from the set {0, 1, H-i). For this class of models 
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and have the following form. 

= ffffl if = VTii; ji3€L 

where w and n are the possible levels the pixel intensity can occupy. The 
parameter serves as the external field for the spatial interaction system 

and it determines the number of pixels of each level in the image. The 
parameter <^scides the penality or reward for equality of and 

The parameter r also affects the penalty or reward. 


2.5 PARAMETER ESTIMATION METHODS 

Given a single image realisation and a particular model; the determination of 
parameters of that model constitutes the estimation problem. It is assumed in the 
present work that the parameters remain invariant to location in the lattice . 

i. Coding method; Let us consider a rectangular lattice L and a single 
realisation X. wle want to estimate the parameters of the assumed model 
distrbution using the single realisation. In order to estimate the parameters 
of the first order distribution model (i.e., the GD model with a nieghbourhood 
system of the first order); we begin by labelling the interior sites of the 
lattice alternately by o and # as shown in figure 2.3. It is olea.?^ from the 
first order Markovian assumption that the variables associated with o sites 
given variables at the « siteS; are mutually independent: So the conditional 
likelihood function over the o sites can be written in the following form. 

JJ P(XCi; j)=X/,;/X<i-i; XCl; j + 1) = x^- i, 

[i , j3 s{ 

X(i + 1, X(l, 
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• c • o # 

C #0*0 

• 0 * 0 # 

o • O • o 

• C • o • 



Figure 2.4: u.s and v.-s With Respect to s 
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where the product is over values associated with o sites. Conditional 
likeihood estimates of the unknown parameters can then be obtained. 
Alternatively; the parameters can be obtained by using the conditional 
likelihood function for the ♦ sites. The two estimates ought to turn out to be 
the same but it is advisable to combine both the estimates. Similarly; model 
parameters can be estimated for higher order neighbourhod systems by this 
method. This method is computationally efficient. 

2 . The method of Derin and Elliot : Histogramming and standard least square 
estimation are the main components in this method. Suppose X is a GRF with 
each X[i;j3€{Q; i; .H— 1). Let s represent the pixel iij) and t' represent the 
vector of the neighbouring pixels of iiJ). = ^2 where 

the u^s and are shown with respect to s in figure 2.4. We define the 
indicator functions 


1(2 i; 22; Zft) 


. _ /-i; 21=22=.. 




otherwise 


where Z;, Z 2 ; .... z^ are the pixel intensity values. 


Js(s) 


( 


1 ; s=Fr> 

I 0 ; otherwise 


We now express t.he potential functions of the GDs in terms of these 
quantities. Let P'(s, t', §) be the sum of the potential functions of all cliques 
that contain (i, j), the site of s. That is, Vis, t', 6 ) = define 9 

to be a parameter vector such that 9 = [a-i, «£, ..., 0;, ..., 04 , 7^, ..., 74 J. 

The formulation considered here is in terms of the ??^ neighbourhood system. 
Using the clique potentials for this class of GD, we can write k'Cs, 9) as 

k'Cs, t', 9) = #T(s, t')>% 


t') is a function of the various indicator functions. Now, suppose PiSjt') 
is the joint distribution of the random variables on the 3X3 block centred at 
(i, j) and Pit') is the joint distribution of the pixels in r)jj only. Then 
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P(s/t') = 

P(t ) 2 


This can be rearranged to 


Z e' 




P(t') P<s,t') ■ 

The left side is independent of s and so is the right side. Taking the ratio 


for s = j and k, we get 


Hence, 


P(k,t') 


K(k, t', e) - k(j, t', 6) = t') - #T<j;tO)-e = 

Hence, we get a linear set of equations with 6 as an unknown parameter set. 
P(s,t') is calculated using histogram techniques. 


2.6 GENERATION OF MARKOV RANDOM FIELD MODELED IMAGES 


There are mainly two methods for generating an image realization from the MRF. 
These are the following. 

hETTRCFOLJS AL(S3RITHM: The Metropolis algorithm was devised to study equillibrium 
properties, especially ensemble averages, time evolutions, and low temperature 
behaviours of very large systems of essentially identical interacting components 
such as molecules in a gas or atoms in binary alloys. In this algorithm, two pixels 
are first chosen at random. Their values are exchanged if they are different and 
if the exchange takes the system into a more probable <i.e., lower energy) 
configuration. If, on the other hand, the new configuration is less probable than 
the earlier one, an exchange will be effected with a probability equal to the ratio 
of the probabilities of the new and the old configurations (that this is indeed a 
legitimate probability function is ensured by the fact that this procedure is 
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resorted to only when the newer configuration has a lower probability than the 
previous one). The procedure is practically implemented by comparing samples of a 
random variable uniformly distributed over CO, 11 with the ratio and effecting the 
exchange only whenever the sample value is less than the ratio. 

This randomization allows state changes to less probable conafigurations 
also. This is precisely what prevents the system from remaining in some local 
energy minima. The ratio of the probabilities of the new and the old configuration 
can be easily calculated due to the equivalence of GDs and MRFs, without actually 
determining the probabilities themselves. It has been proved that this algorithm 
will converge to a configuration that maximizes the joint probability, but 
determination of the rate of convergence is a difficult problem and a satisfactory 
solution does not exist. The initial configuration does not affect the convergence 
properties of the algorithm. It might at most take more or fewer itertions 
depending upon the the initial configuration. An important point to note is that the 
total number of pixels of each value remains the same in the case of Metropolis 
algorithm. This might be a drawback. Cross and Jain have used the algorithm to 
generate textures. 

GIBBS SAhOT FR AND THE SPIN-FLIP AUORIThW: Geman and Geman C203 have used a 
differnt type of algorithm to generate textures. O.n each scan, a pixel is picked at 
random or in a deterministic fashion. Then the pixel value is changed to one of the 
values it can take, with a conditional distribution of 

PtHii, j)=X;j-/X<k, (k, (i,j)EL. 

The pixel visiting mechanism can be deterministic or random but must be such t.hat 
each pixel is visited equally (infinitely) often as the number of iterations 
increases to infinity. Geman and Geman call this algorithm a Gibbs sampler. 
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The annealing temperature in the probability distribution is reduced as the 
algorithm proceeds. They have proved that with an annealing schedule given by: 
Tiky^Co/logiL+k). where Cq is any constant and k the number of iterations^ the 
configuration generated by the algorithm will have a Gibbs distribution and have 
minimum energy with probability converging to one as k-^oc. But this annealing 


schedule is very slow. 



Chapter 3 


Generation and Parameter Estimation 
for Gibbs Distributed Images 

3.1 THE MODEL 


Many types of Gibbs models are found in the literature. Depending upon the choice 
of energy function; we get different types of Gibbs models. Once the model is 
chosen; the parameters governing the model can be varied and images with 
different parameters can be realised. While images can be binary or m-ary; we deal 
here with binary images only. The model we have chosen is a specific type of auto 
Gibbs model. 

Let be a NXN array representing the image. We shall consider a fiv^e 

parameter model. Of these; four parameters effect the spatial interaction and one 
parameter affects the number of white pixels in the image. These features may be 
illustrated using examples. The energy function used for simulating the images is 


the following. 
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UCxCi, j], r},j) = L 

+ ibiC(xCi-lJ-i]-xCi,j])^ + ixli+lJ+n-xiUlf} 

+ baC^xEi-lJl-xQj])^ + <x[i+iJ3-x[i,,!])^} 

+ bg£(xCi-l,.j4.i3-x[i,j3)^ + (x£i+i,j-i3-xCiJ3)^3 
+ b4«x[ij+13-x[i,j])® + (xCi,j-i3-x[iJ3)*} 

EiCxCi J3, is the energy associated with the (ij)th pixel having a 

neighbourhood f)-. 


3.2 THE TEXTURE GENERATION ALGORITHM 


The algorithm used here is the spin-flip algorithm and is specifically described 
here for binary images. We call one run of the algorithm one iteration. Each 
iteration consists of the following steps. Pixels are picked either in order in a 
raster fas.hion, or at random and the probabilities of the two values the pixel 
intensity can take are computed using t.he following GD eauation. 

exp 


PCXCi, j3=X;j) 








where T is a parameter which should be varied in the following manner <k is the 
number of iterations). 

T 1 3.0/2na+k) ...3.2 


if the probability of the pixel having the present value is higher than the 
probability of the pixel taking the other possible value, the pixel value is left 
unaltered in the present state. But if the probability of the present value is less 
than the probability of the other value, a transition to the other value is made 
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with a probability equal to the ratio of the probability of present value to the 
probability of the other value. For this purpose, a sample of a random variable 
uniformly distributed in CO,!] is compared with the ratio and the transition to the 
other value made only if the random number is greater than the ratio. This 
algorithm is used with T = i . The parameter T is then varied using the expression 
3.2 under equality. Reducing T as in exp.f^ession 3.2 is called annealing. The 
algorithm may be summarised as follows: 

A NXN BINARY IMAGE FILE, PARAMETERS. 

OUTPUT: GIBES DISTRIBUTED IMAGE WITH CHOSEN PARAMETERS. 

STEP-i: i=l,j=l 

STEP-2: Find UCxCi,j],T?,-^;) 

STEP-3: Find PCXCi, j] = -i), FCXil Jl = l) 

STEP-4: Let the initial value of the pixel be Xo and the latter value be yg, 

if P(XCi, jl=XQ)iP(Xll Jl=yQh make no change of value. 

STEP-5: If P(.><[i, j]=Xo)<P<.^Ci, j]=yo), generate a realization of Zq 

with probability function UCO, 11, 

STEP-6: If Zo<P(XCi, j]=Xo5/P(XCi, j]=yQ), make no change, 

else change value to yo- 

STEP-7: j=j4-l, 

STEF’-8: If j=N+i, then and j = l 


STEP-9: If then goto STEP-2 else stop. 
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3.3 GONVERGEmE PROPERTIES OF THE ALGORITHM 

The algorithm is used for generating images with and without annealing . Four- 
examples of each case are presented with changing sets of parameters. 

<£HERATIC^ WI1T4CMJT Aht^'EALiNG: For different starting images; the texture 
of the stabilised image remains the same for the same set of parameters. But if 
the parameters are varied; the texture changes . The images are created by 
applying the algorithm for 50 iterations because it is observed that after 20 
iterations, the visual features of the image stabilise. Throughout thiS; T is fixed 
at unity. 

Fig-3. 1(a) and Fig-3. Kb) show images idata and idatai starting from which the 
Gibbs distributed images are generated. These images are generated by using a 
random number generater which generates random numbers uniformly distributed 
between 0 and 1. For each pixel; a uniformly distributed random number between 0 
and i is called; and if the random number is less than 0.5; a value of -f i is 
assigned to the pixel; otherwise a value of — i is assigned. 

Fig-3 .2(a) shows the stabilized image obtained after applying the algorithm 
for 50 iterations starting from idata. Fig-3 .2(b) shows the stabilized image (also 
after 50 ite.^ations) starting from idatai and Fig-3 .2 (g) shows difference. SO; the 
stabilized image textures resemble one another though the images are diffei^ent 
when the starting images are different. Csgg 1 

IHAC^ (S’CRATICl^ WITH AhtCi^ONG: In tha case of image generation with annealing 
T is reduced with each iteration. So, it may be expected t.hat fewer pixel changes 
occur as the number of iterations increases. This is due to t.he nonlinear 
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(a) starting from idata 


(b) starting from idata i 



Stabilised Images .yitnout Annealing 
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character of the distribution function, ThuS; at lower T values; pixel values which 
hav^e higher initial probabilities become much more probable as the iterations 
proceed. As the number of iterations increases beyond thousand; it is observed 
that the number of pixel changes in an iteration reduces to less than ten percent 
of the number of pixels. A graph is shown in Fig-3.3 that displays this behaviour. 
Fig-3.4 shows the stabilised images starting from idata and idatai and the 
difference between the two. ^See 3) 

A variation of the algorithm for use with and without annealing is that 
steps 4-6 are changed. NoW; irrespective of its pi^esent value; every pixel is 
updated to value —1 with probability j] = — i); and to -fi with probability 

P(XCi; j3 = 1.). ThuS; t.his altered procedure probabilistically updates t.he pixel values 
at each site without reference to t.he value at the site before the iteration. It has 
been observed that with this altered procedure; the images start stabilising only 
after a larger number of (500) iterations. 

While this procedure undoubtedly ensures; as intended; an evolution of the 
starting image towards the desired probability distribution after a number of 
iterations; it has the disadvantage of being too slow. 


3.4 SIGiilFICANCE OF THE VARIOUS MODEL PARAMETERS: 

The parameter L affects the number of pixels of any grey level if all the other 
paranmeters are fixed. This is s.hown in the graph in Fig-3.5. If we increase L, the 
relative number of white pixels reduces. The parameters and bg are diagonal 
parameters. The parameter bj. affects the 135* diagonal direction and affects 
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CDr'-j'xr'i — icz> i::3x X c=d 


^ O CD X 
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(g) difterenoe of (a) and (fe) 


Figypg 3.4' 


Stabilised Images Hith Annealing 
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the 45' diagonal direction. This is illustrated in Fig-3 .6(a) and Fig-3 .6(c). The 
parameter dominates in Fig-3 .6(a). The parameter bs dominates in Fig-3 .6(c). The 
vertical direction is affected by parameter b£. This is illustrated in Fig-3 .6(b). 
Similarly the horizantal direction is affected by b 4 and this is illustrated in Fig- 
3.6(d). The parameters used for various images are summarised in Tabla-3.1. 


TAHJE 3.1: Parameters for Figure 3.6(a>-3.6(d) 


Images 

Parameters 

L 

— 

ba 

b.3 

t>4 

figure 3.6(a) 

0.2 

-65.0 

O.i 

O.i 

O.i 

figure 3.6(b) 

0.2 

O.i 

-65.0 

o.i 

0.1 

figure 3.6(c) 

0.2 

0.1 

0.1 

1 

-65.0 

0.1 

figure 3.6(d) 

0.2 

0.1 

; 0.1 

0.1 

-65.0 


3.5 PARAMETER ESTIMATION METHOD 

The paraimeter estimation method we present here is based on histogramming the 
image. The images considered are of binary type. If we take an 7? neighbourhood 
system, there are eight neighbours for each pixel, and thus, 256 possible types of 
neighbourhoods. Let xEi,jl be the image. In the image, the low level is represented ; 
as -1 and the high level is represented as +L. Let yEi,j3 represent the same image 
with the low level represented as D and the high level as -hi. If value of the 
nearest top left diagonal pixel is taken as the least significant bit and the pixel 
above is taken as the next bit and so on, every pixel neighbourhood can be 
represented by an 8-bit binary number. The decimal value of the 8-bit binary 
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(g) right diagonal direction parameter dominant 



(d) horizontal direction parameter dominant 


Right diagonal and horizontal direotion parameters dominant 


Figur-e 3.6: 
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number representing the neighbourhood can assume values between 0 and 255. This 
number shall be called the state of the pixel. 

The strategy adopted is that we start scanning the image in a raster 
fashion and search for each type (out of the 256 possible types) of neighbourhood 
in the image matrix. When a pixel is found to have a given type of neighbour- 

hood k; the pixel value is checked in the matrix xlijl and if it is -fl then the 
counter hCk;+i3 that counts the number of occurences of pixels with value -fi and 
neighbourhood is incremented; else n[k;— 13 is incremented. After the scanning is 
completed over the entire image the result in is equal to number of pixels 

with value +i and with neighbourhood k. Let NLk] = n[k;-fi3 4* nEk,— 13. The ratio 
n[k,4-i3/NCk3 = P[k;4-i3 represents the empirically determined probability of a pixel 
taking value 4-1 when the neighbourhood is k. Similarly; r>[k;— 13 /NEk] = PEk;— 13. 

Equipped with this information; our goal is to find the parameters of the CD 

governing the statistical properties of the image. In other words we have to solve 
a set of nonlinear equations to get the unknown parameters. 

Solving the nonlinear equations is a tedious task; but fortunately; these 

equations can be transformed into a set of simultaneous linear equations. Then 

these equations can be solved by standard methods such as Gauss elimination. We 
use this method to find the parameters of simulated images. 
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3.6 PARAMETER ESTIMATION BY SOLVING 
SIMULTANEOUS EQUATIONS 

To obtain a set of simultaneous equations from the nonlinear equationSi we divide 
PCk/— i] if P[kj— i] is a nonzero quantity and take the logarithm of the 
result. Cases where P[k;~13 is zero have not been considered. This provides us 
with a maximum of 256 simultaneous equations in 5 unknowns. The equations are 
solved using the Gauss elimination method. 


^" 0,2 ^-0,3 ^0,4 ^0,5 j 

^ i ! i 


} 

u. 

bi 

bj 


,.P[0,+13 

PL0,-n 

^2554 ^255,2 ^255,3 ^^255,4 ^255,5 

- - 


bg 

t>4 


, P[255, +i3 

( PC255,-i3 ! 

L J 


The coefficients to in each row of the coefficient matrix are the 

coefficients of the parameters in the expression LT— l,k3 — 


This method is used to estimate the parameters of vai^ious simulated images, 
and then; with the estimated parameters; the images are again generated. The 
initial and final images are compared and results founc to be satisfactory. Before 
presenting thg algorithm, we give the vreoisa defirition of the type of a 

neighbour hood . 


DEFIKITIGN i: A pixel (i. 
f r 3:5: ijf whe''~o the state 


J" is said to 
of the pixel 


have a neighbourhood of type k the 
is computed by the following expression, 


state 


4- 2 *yLl — t* ^ 

4 2'^*yG41.»v?4ii 4 2 •yCi T'i.f.b 4 ^ *yEi4***U“”U3 4 ^ ... 0.0 
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where 

y[i,j] = + 1) . 

The algorithm is as follows: 


...3.4 


M=*Lrr: A BINARY IMAGE FILE 
OUTPUT: PARAMETERS OF THE IMAGE. 

STEP-i: Form the matrix y[i,jl from xLiJ] using equation (3.4) 

STEP-2: Form the matrix s[i,j] 

STEP-3: i = i,j = l 


STEP-4: MsCiUl = NEsCiJl + i 

STEP-5- If yCiKj3 = i then nCsCi,A -f-il = nCsEiJl, +11 -f i 
else nEsCijj],— 13 = nEsEij],— 13 + 1 

STEP-6: 

STEP-7: If J=N+1 then i=i+l and J = 1 

STEP-S: If i=N-i-l then goto STEP-9 else goto STEP-4 

STEP-g: For k=Q to 255 find P[k,+il =n£k,+i]/NLk] 
and PEk;-13 = nEk;-13/NEW 

STEP-iO: Form the kXl matrix Iog(POr,-!-13/FEk,-13) 

STEF-il; Form the coefficient matrix of the matrix equation by taking the 

coefficients of the parameters in the expression UC— l,kj — UE-i-l,k3. 
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8TEP“i2: Applvj Gauss eiimination to scdve for the pa-amEters. 
ETEP~i3: Stop 


Regarding the algorithm the foilDwing points have to be kept in mind. 


It has been assumed here that the parameters of the model are the same 
through'Out the image, this is not the oase.; the irriage has to be segmented 
into diffe^^ent regions depending upon the texture and hisiograrriming has to 
be done separately for each region. I.n that oasej panarnsters of different 
ragioriB would be diffef“'ent; and all t.he computations would have to be carried 
out sepa^-'ately for each of the regions. 


All the neighbourhoods of the pixels on the edges are not known: so the 
unknown pixels car be arbitrarily taken to be either -fi on — i. Alternatively, 
the oute?"*- pixels can be left out for the purpose of computing histograms- 
about them and used only i.n t.he status of neighfacurs for the inner pixels 
whils histogramniing is dcrje o.n the rest of the pixels. 


3.7 SIMULATION RESULTS 


The algorithm has been tested for the images Fig-3 .7(a) to Fig-3 .5(5;.). The 
para, meters of the image 3.7(a.) we.'-e estimated a.nd from the estimated parameters 
the image 3.7(b) was generated. The texture of both the images are founa to pe i-he 
same., justifying the method. Similarly.- images 3.8(a) and 3.9Ca) were generated for 
different para.miete" sets and t.he parameters qT the resulting were estimated. 
Finally, using the estimated parameters, the images 3 Sib) and 3.9(b) respactively 
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(a) original iniags 



(b) image generated using estimated parameter; 
Figure 3.S: Original and Reconstrueted Images 
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original image 



(b) image generated using estimated parameters 


Figure 3.S- 


Original and Reconstructed Images 
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were generated. For the cases that were considered, good results have been 
obtained. The results of parameter estimation tests are summarized in Table 3.2. 


TAM-E 32: Ch^iginal and Estimated Parameter 



Original Paramet®^ 

Estimated Parameto^ 

L 



bs 

^4 

L 

bi 

b2 

bs 

^4 

figure 3.7 

0.2 

O.i 

-0.6 

0.1 

0.1 

0.2 

0.22 

-0.5 

0.1 

0.1 

figure 3.8 

0.2 

-65.0 

0,1 

0.1 

0.1 

0.2 

-60.0 

0.1 

D.l 

0.09 

figure 3.9 

i 

0.2 1 
I 

-0.6 

-0,09 

1 

0.1 

0.1 1 

0.3 

1 

-0.4 

-0.1 

0.2 ; 

0.1 


3.8 PARALLEL INPLEHENTATION OF THE ALGORlTHli 

If the process of histogramming is done in parallel, there is a time saving. With a 
single processor, the time required is O(N^) if the image is an NxM array, whereas 
the parallel implementation suggested requires only OQog(N)) time. But this saving 
in time is obtained at the cost of an increase in the number of processors to 
O(N^). 


The parallel machine proposed is shown in Fig-3.13. The process of 
searching for different types of neighbourhoods is made parallel, if all the eight 
neighbours of a pixel in the image xCi,j3 are combined to form the neighbourhood 
vector, then each element of the vector is either +1 or —1. The nearest left 
diagonal element is taken as the first element and the pixel above as the next ele- 
ment, and so on. Let us represent the vectors by Vtil where i ranges from 0 to 255. 
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A given type of rseighbourhood is tested for a pixel by computing the dot 
product of the vector coressponding to each of the 256 types of neighbourhood 
vectors possible with the neighbourhood vector of the pixel. The value of the dot 
product with each neighbourhood is compared with 7 and if the product is greater 
than 7/ it is decided that the pixel under study has the neighbourhood with whose 
vector^ a dot product greater than 7 was obtained. 

If the number of pixels is M, the number of pixels required is of OCM). Once 
the neighbourhood of a pixel is found, the value of the pixel has to be tested. This 
can be done by multiplying the threshold output by the value of the centre pixel 
and if the value is 4-i> nCk-^-fl] is incremented else n[k,— 13 is incremented. This 
procedure has to be repeated for all the pixels. Using the values of nCkn-fil and 
nCk,— iX the values of P[k,4*i3 and PEk,— il have to be found for all 'k. Finally, the 
parameters can be evaluated using the Gauss elimination method. 



Chapter 4 


Applications of Gibbs Distribution Models 


In the previous chapter, we presented a method of generating Gibbs distributed 
images. Effects of changing various model parameters on the image texture were 
also studied The effect of diffenent starting images on the texture of the 
stabilised image was also discussed. In this chapter, we are presenting two 
application of Gibbs distribution models to image compression. First, we show that 
the Gibbs distribution models can be applied for the purpose of image compression. 
Later, we apply the models for the purpose of texture classification. 


4.1 WAGE CONPRESSION MTHOD 

Using the same notation as in the previous chapters^ we denote any image by the 
array xCiUX where i and j vary from 1 to H. From the results presented in 
Chapters, it is amply evident that in applications where only the texfMre of an 
image has relevence, a knowledge of the parameters of the image suffices for 
reconstructing it . In practical cases, if we assume that 16 bits are required to 
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encode the information of each oarameter, the compression ratio achieved is of 
the order of 5D for a. 64x64 image and even greater if the image is larger. 

But if the actual image has to be recovered, i.e., more than just the texture 
information is desired, a very different approach is warranted. The possibility of 
reconstructing the whole image starting from a part of the image may be 
investigated. If the image is of binary type, then NXN bits of information are 
necessary to represent the image. Our purpose is to represent the same image in 
terms of a smaller number of bits, while at the same time, keeping the 
reconstruction error within bounds. The error is defined as the number of pixels 
on which the reconstructed and the original image differ measured as a percentage 
of the total number of pixels. 

Such a means of image compression is possible only if values of some pixels 
of the image can be predicted in terms of the values of the other pixels. This is 
indeed possible in our model because the probability distribution of the value of a 
pixel is represented in terms of the values of its neighbours. So, if all the 
neighbours of any pixel are known as also the parameters of the image, the value 
of the pixel can be predicted. But by those means, the data compression obtained 
is only about 10 percent. To achieve further compression, we attempt at 
compromising upon the amount of data needed to record the values of all the 
neighbuors of a pixel. To do this by utilising the GD model, we find out which of 
the (four) parameters other than L is dominant (more negtive), and depending upon 
which is the most dominant, ensure that at least the neighbours corresponding to 
that parameter are known while predicting an unknown pixel. In practical 
implementations satisfying this criterion, there could be many ways of leaving out 


some of the pixels during compression. 
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STEP-6: J=:j + 1 

STEP-7: If j<N+l then goto STEP-4. 

STEP-8: i=i+i, j = l. 

STEP-9: If i<N4-i then goto STEP-3, 

STEP-10: Stop. 

This algorithm uses the conceot of maximum likelihood prediction. Use of a similar 
technique can be found in [313. But there, as no modelling of the image is done, a 
table reoresenting the probability distribution for each neighbourhood has to be 
maintained. Thus, in that case the compression ratio was drastically reduced due 
to that requirement. But in our case, only the parameters need to be transmitted 
along with the alternate rows. Of course, the reciever structure becomes more 
complex because the probabilities have to be evaluated. 

This algorithm was implemented with different sets of parameters. The 
results obtained are summarised in Table-4.1, Fig-4.1(a) shows the original image 
and Fig-4, Kb) shows the reconstructed image and Fig-4. ICc) shows the difference 
between the original and reconstructed images. Other examples are given in 
figures 4.2 and 4.3. 


Image 

% Error 

Figure 4.1 

0.00 

Figure 4.2 

0.61 

Figure 4.3 

0.51 

i 
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(b) recovered image 
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Figure 4.2' Original, Recovered and tumor Images 
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4.2 TEXTURE CLASSIFICATION METHOD 

The texture classification problem we intend to pose is as follows. Given h' 
classes of images chareoterised by their parameters (and therefore, their 
textures/, and given a new image, how to classify the given image into one of the 
classes. In other words, it is a texture matching problem. 

The sti^ategy followed is that first, the parameters of the presented image 
are estimated. Then, an appropriate measure based on the difference of parameters 
of the presented image and the parameters charaoterising the various classes is 
evaluated The measure used is order equivalent to the Euclidean distance from 
the estimated pai"ameter set of the image given and the parameter sets 
characterising the various classes. The distance from the estimate to any 
particular class is computed by calculating the sum of the squares of the 
differences between the corresponding parameter values. The presented image is 
finally assigned to the class for which the measure is minimum. The algorithm, used 
is as folllows. 

INPin": The image to be olassified and parameters of the different classes. 
OUTPUT: The class to which the presented image is assigned. 

STEP-1: Find the parameters of the presented image. 

STEP-2: Evaluate EiCt,) -bf for each class where b/Ci,) is the ith 

parameter of the Hh class and b,- is the ith estimated parameter of the 
presented image. 

STEP-3: Find k for which Eic*,) is minimum, is the class of the presented image. 


STEP-4: 


Stop, 
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The procedure can be made adaptive. In that case, as more and more images 
are classified, the parameter sets of the classes can be updated by averaging 
over all the parameter sets of the images allocated to the respective classes . If 
£(Cfc) for a given image is too large for every c^, then the creation of a new class 
may be considered. If the least E(c^) does not point to a unique class on account of 
more than o.ne class being at the same least distance, the classification procedure 
may be refined by assigning the image to that class among them for which the 
parameter dominant in the image is the closest. 

For estimating the parameters, the parameter estimation method presented in 
Chapter 3 has been used. In Fig-4.4 the representative images of different classes 
are shown and in Fig-4.5 and 4.6, we show two presented images. The former image 
was assigned to Cg and the latter to Cg. 
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(b) class C 2 


Figure 4.4 
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<d) class c -4 


Figure 4.4 
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Chapter 5 


Conclusions and Scope for Future Work 


5.1 CONCLUSION 


In this thesis, we have studied some aspects of an image generation algorithm 
known as the soin-flip algorithm. We have observed that the final image texture is 
the same irrespective of the starting image. Effects of changing various parame- 
ters have also been studied. 

A new parameter estimation algorithm is also proposed. In that algorithm, the 
parameters are assurried to be the same throughout the image. An type of 
neighbourhood system has been considered, so that there a.^'e a total of 256 types 
of neighbourhoods possible. Each type of neighbourhood is scanned in turn and its 
probability distribution at the center pixel noted. This information is used to form 
simultaneous equations with the parameters as the unknowns. This method was 
applied to various simulated images, and using the estimated parameters, images 
were again reconstructed. The algorithm was tested on various simulated images 
and it was found that the images generated using the estimated parameters had the 
same texture as the original image, thus justifying the algorithm. 
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Next, the Gibbs distribution model was aoDlied to the image camoression 
problem. Image compression was achieved by removing some pixels from images, and 
then recovering 'them by replacing them by their maximum likelihood estimates. On 
various simulated images a compression ratio of two was obtained without run- 
length coding with ef-'ror levels less than 5’/,. 

Finally, using the parameters of images, texture classification was attempt- 
ed. The algorithm used was non-adaptive. The problem was posed as follows: given 
the parameters for various classes, and an image, how is the image to be classi- 
fied?. A measure that depended upon the difference of parameters was evaluated 
between the estimated parameters of the given image and the parameters character- 
ising the various classes, and the image was attached to the class with which the 
measure was found to be minimum. The method was tried with various input textures 
and in all cases taken up, correct classification was obtained. 


5.2 SUGGESTIONS FOR FUTURE WORK 

In the case of image compression, there are many aspects which have not been 
investigated because of lack of time. An analytical relation between the number of 
pixels remo','ed and the error in construction is required. Also, the locations of 
pixels removed while effecting image compression also affect the error, this too 
has to be investigated more rigorously. 

The use of the image compression method on real images was not tried out. 
For real images, regions of similar texture have to first be identified, and for 
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each region, parameters have to be estimated independently. Moreover, the 
parameters for different regions have all to be transmitted. 

Finally, the texture classification method can be made adaptive. The image 
classification exercise is started with some initially chosen sets of parameters 
for each class. As more and more images are classified with the use of these 
original paramnter sets, it is possible to refine the classification with the help of 
the knowledge gained from the images already classified. One method of making the 
classifier adaptive is the following.’ every time a new image is classified, the 
parameters the class to which it belongs should be appropriately updated. By 
properly selecting the form of this updating procedure, it may be ensured that 
while newer images get classified as per the updated parameter sets representing 
each class, the classification of no previous image will need to be revised on 


account of the continual updating of the parameter sets. 
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